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Abstract 

Since a long time ago, agriculture has been a significant part of the Indian economy. 18% of India's 
gross domestic product is produced by the agriculture sector (GDP). A better answer for precision 
agriculture is provided by robotics and the internet of things. Selective harvesting is necessary when 
picking fruits or vegetables like tomatoes and apples. In traditional farming, each fruit is hand-picked 
by a worker, requiring a huge amount of labour to carry out selective farming. We suggest a robot 
that helps farmers with a variety of labor-intensive chores, such as selective crop harvesting and 
qualitative segregation, while also simultaneously providing data on crop health, soil nutritional status, 
and crop shelf-life detection. An android application is used to analyse, process, and send the obtained 
data to the farmer. Later, the weight, colour, and health of the particular crop are checked to grade its 
quality. The fruit is subsequently moved into the designated container after being graded. Spoiled or 
overripe fruits and vegetables would be plucked and dropped so as not to interfere with the plant's 
growth. A harvesting arm on the proposed robot would reach the fruit or vegetable and pick it from 
the plant or tree. The work given here is a mini-project that is taken up as a part of the curriculum 
completed by electronics and communication engineering students in the second year of the 
electronics & communication engineering department at Dayananda Sagar College of Engineering in 
Bangalore. 
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1.Introduction 

The declining number of agricultural employees and rising cost of fruit picking are only two of the 
issues facing the agriculture sector. In order to solve these issues, agriculture must be scaled up and 
labour costs reduced [1]. For labor-saving and industrial-scale agriculture, agriculture automation has 
advanced recently. However, physical labour is still used extensively in the sector of fruit harvesting. 
The creation of a robotic fruit harvester is a workable answer to these issues [2]. 


2. Significant works done 

Two significant duties are involved in a robot's autonomous fruit harvesting: 

(1) Using computer vision and a sensor, find and locate fruit on trees. 

(2) The end effector of the robot arm moves to the location of the recognised fruit and harvests it 
without harming the target fruit or its tree [18]. 

We humans have reached the limit of our cognitive abilities due to the development of technology, 
and we are now attempting to combine the functions of a natural brain with those of an artificial one. 
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Artificial intelligence is a brand-new field that was created as a result of this ongoing investigation. 
It is the method by which a person can create a machine with intelligence [3]. 

As demonstrated, among the many factors that affect productivity, crop diseases receive the majority 
of the credit. It demonstrates how early disease detection and identification is crucial for boosting 
business margins. Satellite farming, which supports the management of farm activities by going site- 
specific, is specifically related to precision farming. It is mostly built on using technology to track, 
gauge, and analyse crop productivity. It is regarded as one of the fundamental components of the 
contemporary agricultural revolution. By the end of 2050, the world's population may total 9.6 billion 
people. To feed every individual, this would necessitate double output. Precision agriculture is 
developing mostly in line with two themes, Big Data & advanced analytics and robotics, claims 
McKinsey. Aerial photography, sensor technology, and accurate local weather forecasts with GPS 
capabilities are all included [4]. 


3. Precision farming 

Precision farming is more concerned with preserving environmental sustainability, industrial 
profitability, and machinery effectiveness. The farmers rotate their crops to increase crop health and 
variety, and they keep an eye on irrigation rates to prevent salt buildup from destroying their crops 
[17]. Additionally, adding fertilisers, water, seeds, and other agricultural inputs in order to grow a 
range of crops in various soil environments is a wonderful technique followed by the majority of farm 
managers. Additionally, it includes other components like computer-based applications, GPS soil 
sampling, variable rate technology (VRT), and remote sensing [5]. 

AI is a branch of computer science that can recognise its environment and should prosper to increase 
the likelihood of success. Work that is dependent on prior learning should be possible for AI. A few 
areas that improve machine work and aid in the development of more advanced technology are deep 
learning, CNN, ANN, and machine learning. It is explained that IOT refers to "thing to thing" 
communication [6]. 


4. Three important goals in farming 

The three key goals are system cost reduction, automation, and communication. Medical science, 
education, finance, industry, security, and many more fields have all been affected by AI. AI 
implementation involves the machine learning process. This brings us to the "Machine learning" sub- 
section of this AI area. Machine learning serves the primary aim of providing the computer with 
historical data and statistical information so that it may carry out the work that has been set to it— 
solving a specific problem. Today's uses range from speech and face recognition to data analysis 
using historical data and experience. Numerous studies have looked into fruit localization and 
detection on trees using computer vision, and the majority of these works have been compiled in the 
review by Gongal et.al [7]. 

These techniques frequently employ cameras that are colour, spectral, or thermal. It is challenging to 
identify a fruit that is cast in shadow by another fruit when using a spectral camera. Based on the 
temperature difference between the fruit and the background, a thermal camera can identify fruit. The 
size of the fruit and its exposure to direct sunlight have an impact on this procedure. Fruit detection 
with a colour camera uses a variety of different features [16]. To segment an apple, Bulanon employed 
brightness and the RGB colour difference. analysed texture to find an apple. Linker combined a 
number of factors to increase the precision of fruit detecting techniques [9]. 

Using a colour camera, several image classification techniques for fruit detection can also be carried 
out. K-mean clustering was employed by Bulanon to detect apples. KNN clustering was used by 
Linker et al. and Cohen et al. to classify apples. Kurtulmus also classified apples using an artificial 
neural network [15]. For apple detection, Qiang employed a Support Vector Machine classification 
technique. However, because the colour information cannot be sufficiently collected, these 
approaches are challenging to employ in varying lighting circumstances. Fruit detection should be 
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carried out using several features, such as colour, shape, texture, and reflection, to improve accuracy 
and get around problems like clustering and fluctuating lighting [8]. 


5. Automated farming approaches 

In order to carry out automatic fruit harvesting by a robot, the current study suggests "fruit detection 
and localization" and "fruit harvesting by a robot manipulator with a hand which is able to harvest 
without hurting the fruit and its tree." To determine the fruit's position in two dimensions (2D), we 
employed a colour camera and a Single Shot MultiBox Detector (SSD). The Convolution Neural 
Network (SSD) is one of the common object detection techniques (CNN). Te SSD can make accurate 
judgements based on colour and shape [14]. To give the robot arm a command, one must first establish 
a three-dimensional (3D) position. The fruit detected by the SSD is measured using a stereo camera 
in its three-dimensional (3D) position [10]. 

In order to determine the path taken by the robot arm, we used inverse kinematics. Based on inverse 
kinematics, we moved the robot arm to the position of the fruit. The harvesting robot's hand served 
as our end effector. By grasping and turning the fruit, the robot hand collects it without hurting the 
fruit or its tree. The UN Food and Agriculture Organization projects that by 2050, there will be a 2 
billion rise in population. Only 4% more land will, however, be under cultivation by that time. 
Utilizing modern technical advancements to increase farming efficiency continues to be one of the 
most important requirements in this context [11]. While artificial intelligence (AI) has many practical 
applications in many other fields, it has the potential to fundamentally alter how we now view farming. 
Al-powered solutions will not only help farmers produce more with fewer resources, but they will 
also boost crop quality and assure a quicker time to market. The use of drone-based image processing 
techniques, the landscape of precision farming, the future of agriculture, and upcoming problems are 
all topics we'll cover in this essay [12]. 


6. Conclusions & Recommendations at the Next Steps 

We are creating a prototype for a robot that will perform precision farming in this project report. In 
the final year of the 7th and 8th semesters of the UG-BE course, a synopsis of the project work that 
will be completed is presented. In this exciting field, a thorough literature review was conducted 
regarding the various algorithms that can be used for selective harvesting and segregation. During 
this time, all pertinent papers from various sources were gathered and studied in greater detail. A 
thorough analysis was then made, and the project problem was finally determined [13]. 
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